442,583 research outputs found
Bayesian optimization for computationally extensive probability distributions
An efficient method for finding a better maximizer of computationally
extensive probability distributions is proposed on the basis of a Bayesian
optimization technique. A key idea of the proposed method is to use extreme
values of acquisition functions by Gaussian processes for the next training
phase, which should be located near a local maximum or a global maximum of the
probability distribution. Our Bayesian optimization technique is applied to the
posterior distribution in the effective physical model estimation, which is a
computationally extensive probability distribution. Even when the number of
sampling points on the posterior distributions is fixed to be small, the
Bayesian optimization provides a better maximizer of the posterior
distributions in comparison to those by the random search method, the steepest
descent method, or the Monte Carlo method. Furthermore, the Bayesian
optimization improves the results efficiently by combining the steepest descent
method and thus it is a powerful tool to search for a better maximizer of
computationally extensive probability distributions.Comment: 13 pages, 5 figure
Efficient Bayesian hierarchical functional data analysis with basis function approximations using Gaussian-Wishart processes
Functional data are defined as realizations of random functions (mostly
smooth functions) varying over a continuum, which are usually collected with
measurement errors on discretized grids. In order to accurately smooth noisy
functional observations and deal with the issue of high-dimensional observation
grids, we propose a novel Bayesian method based on the Bayesian hierarchical
model with a Gaussian-Wishart process prior and basis function representations.
We first derive an induced model for the basis-function coefficients of the
functional data, and then use this model to conduct posterior inference through
Markov chain Monte Carlo. Compared to the standard Bayesian inference that
suffers serious computational burden and unstableness for analyzing
high-dimensional functional data, our method greatly improves the computational
scalability and stability, while inheriting the advantage of simultaneously
smoothing raw observations and estimating the mean-covariance functions in a
nonparametric way. In addition, our method can naturally handle functional data
observed on random or uncommon grids. Simulation and real studies demonstrate
that our method produces similar results as the standard Bayesian inference
with low-dimensional common grids, while efficiently smoothing and estimating
functional data with random and high-dimensional observation grids where the
standard Bayesian inference fails. In conclusion, our method can efficiently
smooth and estimate high-dimensional functional data, providing one way to
resolve the curse of dimensionality for Bayesian functional data analysis with
Gaussian-Wishart processes.Comment: Under revie
Bayesian topology identification of linear dynamic networks
In networks of dynamic systems, one challenge is to identify the
interconnection structure on the basis of measured signals. Inspired by a
Bayesian approach in [1], in this paper, we explore a Bayesian model selection
method for identifying the connectivity of networks of transfer functions,
without the need to estimate the dynamics. The algorithm employs a Bayesian
measure and a forward-backward search algorithm. To obtain the Bayesian
measure, the impulse responses of network modules are modeled as Gaussian
processes and the hyperparameters are estimated by marginal likelihood
maximization using the expectation-maximization algorithm. Numerical results
demonstrate the effectiveness of this method
- …